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Executive Summary 



The use of accommodations for both instruction and assessment continues to be of great impor- 
tance for students with disabilities. Numerous efforts are underway to ensure that students with 
disabilities participate meaningfully in more inclusive classrooms and large-scale assessments. 
Still, there is a need for greater understanding of the ways in which accommodations are selected 
and implemented during classroom instruction and assessments. As states work to improve 
the validity of assessment results when accommodations are used, researchers are faced with 
the challenge of exploring the effects of accommodations on assessment results to determine 
whether the accommodations increase accessibility without changing the content being tested. 

The purpose of this report is to provide an update on the state of the research on testing accom- 
modations, as well as to identify promising areas of research likely to contribute to understanding 
of current and emerging issues. The research is summarized to facilitate a discussion of trends 
in current research and to provide a better understanding of the implications related to accom- 
modations use in the development of future policy directions, implementation of current and 
new accommodations, and the reliable and valid interpretation when used in testing situations. 

Many of the 40 research studies reviewed sought to study the effects of accommodations on 
scores or to compare accommodated scores to non- accommodated versions of a similar testing 
instrument. The most researched content areas were mathematics and reading. Most studies 
used a large sample of more than 300 participants, who often were K- 12 students; students often 
were from multiple grade levels. Research samples most often included students with learning 
disabilities compared to other disability classifications. Presentation accommodations were 
studied by more than half of all the research studies published in 2007-2008. 

Findings from these studies were mixed for most specific accommodations, such as read-aloud 
and extended time, as well as for studies in which accommodations were aggregated. There was 
some consensus on the equivalence of computer-based tests and paper-and-pencil test formats. 
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Overview 



Federal legislation has spurred states to include all students in statewide assessment, and there 
has been much improvement during the past decade. For increased numbers of students with 
disabilities, access to the test relies on the provision of assessment accommodations. As the use of 
accommodations has increased, there has been a concomitant need to attend to the implementation 
of accommodations and the validity of results when accommodations are used. In these, states 
look to educational research for answers about which accommodations have proven successful 
in increasing the validity of results for students with disabilities. Often this means looking for 
increased scores for students with disabilities, along with evidence that the constructs measured 
or the validity of inferences that can be drawn from results are not changed. 

To synthesize research efforts, NCEO has provided reports on accommodations research com- 
pleted over time. The time periods included 1999-2001 (Thompson, Blount, & Thurlow, 2002), 
2002-2004 (Johnstone, Altman, Thurlow, & Thompson, 2006), and 2005-2006 (Zenisky & 
Sireci, 2007). 

The purpose of this document is to provide a synthesis of the research on test accommoda- 
tions published in 2007 and 2008. The research described here encompasses empirical studies 
of score comparability and validity studies as well as investigations into accommodations use 
and perceptions of their effectiveness. Taken together, the current research casts a wide net in 
exploring a variety of the issues surrounding test accommodations practices, with a number of 
efforts made on key accommodations. Insofar as reporting on the findings of current research 
studies is a primary goal of this analysis, a second goal is to also identify areas requiring con- 
tinued investigation in the future. 

Review Process 

Similar to the process used in the past accommodations research syntheses (Johnstone et al., 
2006; Thompson, Blount, & Thurlow, 2002; Zenisky et al., 2007), a number of sources were used 
to complete the review of the accommodations research published in 2007 and 2008. Specifi- 
cally, seven research databases were consulted, including Educational Resources Information 
Center (ERIC), Psychlnfo, Academic Search Premier, Digital Dissertations, Education Complete, 
and Educational Abstracts. In addition, two Web search engines also were used — Google and 
Google Scholar). 

Several other resources for research articles that were also searched for relevant publications 
were the archives of Behavioral Research and Teaching (BRT) at the University of Oregon (http:// 
brt.uoregon.edu/), the Educational Policy Analysis Archives (EPAA; http://epaa.asu.edu), the 
National Center for Research on Evaluation, Standards, and Student Testing (CRESST; http:// 
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www.cse.ucla.edu/), the Wisconsin Center for Educational Research (WCER; http://www.wcer 
.wisc.edu/testacc), and the Center for the Study of Assessment Validity and Evaluation (C-SAVE; 
http://www.c-save.umd.edu/index.html). 

The initial search was completed in November, 2008. A second search was completed in April, 
2009 to ensure that all articles published in 2008 were found and included in this review. Within 
each of these research databases and publications archives, a sequence of search terms was used. 
Terms searched for this review were: 

• accommodation(s) 

• test and assess ( also tests, testing, assessing, assessment) accommodation(s) 

• test and assess ( also tests, testing, assessing, assessment) changes 

• test and assess ( also tests, testing, assessing, assessment) modification(s) 

• test and assess ( also tests, testing, assessing, assessment) adaptation (adapt, adapting) 

• student(s) with disability (disabilities) test and assess ( also tests, testing, assessing, 
assessment) 

• standards-based testing accommodations 

• large-scale testing accommodations 

The research documents from these searches were then considered for inclusion in this review 
with respect to several criteria. First, the decision was made to focus only on research published 
or defended in doctoral dissertations in 2007 and 2008. Second, the scope of the research was 
limited to investigations of accommodations for regular assessment (hence, articles specific to 
alternate assessments, accommodations for instruction or learning, and universal design in gen- 
eral were not part of this review). Third, research involving English language learners (ELLs) 
only was included if the target population was ELLs with disabilities. Finally, it should also be 
noted that presentations from professional conferences were not searched or included in this 
review, based on the researchers’ criteria to only include research that would be accessible to 
readers and that had gone through the level of peer review typically required for publication in 
professional journals or through a doctoral committee review. 

Results 

The results of the review process showed a total of 40 studies were published from January 2007 
through December 2008. As shown in Figure 1, of these 40 studies, 25 were journal articles, 13 
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were dissertations, and 2 were published professional reports released by research organizations 
(e.g., CRESST, Behavior Research and Training). 

Accommodations research takes a variety of approaches. They range from a large-scale approach 
that might examine aggregated accommodations data to an approach that involves testing an 
individual accommodation for a specific disability category. This range of approaches is reflected 
in research questions that focus on areas such as: the use or implementation of accommodations; 
the perception of accommodations by educational professionals, students, and parents; and the 
effects of accommodations on test scores. 

Figure 1. Percentage of Accommodations Studies by Publication Type 



Dissertation 
(n= 13 ) 



33 % 




Journal 
(n= 25 ) 
62 % 



To reflect the wide range of accommodations research that was conducted in 2007 and 2008, 
the studies are summarized and compared in the following ways: (a) purposes of research; (b) 
research type and data collection source; (c) assessment or data collection focus; (d) charac- 
teristics of the independent and dependent variables under study; (e) comparability of findings 
between studies in similar domains; and (f) limitations and directions of future research. The 
information provided in each of these categories should provide insight into the current state of 
accommodations research in education and highlight trends in current accommodations research. 

Purposes of the Research 

A number of purposes were identified in the accommodations research published in 2007 and 
2008 (see Table 1). The most common purpose during this period was to demonstrate the ef- 
fect of accommodations on test scores. This included studies that attempted to demonstrate that 
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accommodations provided students with disabilities with a differential boost (Fuchs, & Fuchs, 
2001; Zenisky, et al. 2007) to their scores not by making the test easier, but by facilitating their 
access to the content through the use of accommodations. Differential boost theory suggests that 
students needing accommodations will gain more from their use than students who do not need 
them. There was a wide range in the educational level included in the research, accommodation 
type, and content areas for studies of similar purposes. 



Table 1 . Purposes of Reviewed Research 



Purpose 


Number of Studies 


Study effect of accommodations on scores 


13 


Compare scores between standard/non-standard groups 


11 


Report on implementation 


8 


Study/compare perceptions of accommodation use 


5 


Meta-analysis on test accommodations 


1 


Identify predictors of the need for test accommodations 


1 


Investigate test validity 


1 


Total 


40 



A full listing of the studies with statements of purposes, organized by purpose category, is 
provided in Appendix A. As shown in Table 1, the most commonly identified purpose in recent 
accommodations research is determining the effect of accommodations on scores or compar- 
ing scores between students with and without accommodations, or between students with and 
without disabilities. These types of studies account for 60% of the research conducted in this 
area. Research on the implementation of accommodations and perceptions of accommodations 
use from teachers and students is also fairly common. 

Research Type and Data Collection Source 

Just over half of the accommodations research reviewed here used a descriptive quantitative 
research design to gather data on the research purposes. As seen in Table 2, quasi-experimental 
and descriptive qualitative research increased in 2008 compared to 2007, while descriptive 
quantitative methods decreased slightly. Furthermore, there appeared to be balance between data 
collection methods, with about the same number of studies using primary and secondary sources 
each year. Primary data sources included actual data collection procedures that researchers un- 
dertook to obtain their data. Secondary data collection included the use of archival or extant data. 
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Table 2. Research Type and Data Collection Source by Year 



Research Design 


Data Collection Source 3 


Research 

Type 

Totals 


Primary 


Secondary 


2007 


2008 


2007 


2008 


Quasi-experimental 


2 


5 


1 


2 


10 


Descriptive quantitative 


6 


4 


7 


5 


22 


Descriptive qualitative 


1 


4 


0 


1 


6 


Correlation/prediction 


0 


0 


0 


2 


2 


Year Totals 


9 


13 


8 


10 


40 


Source Totals Across Years 


22 


18 


40 



a Primary data source involved data collection by researcher. Secondary data source included the use of archival 
or extant data. 



Assessment/Data Collection Focus 

The data obtained through either primary or secondary data collection procedures came from 
a number of sources, as seen in Figure 2. The majority of the research on accommodations 
included in this synthesis for 2007-2009 focused on data acquired through testing. There were 
also a number of studies that used surveys to gather data; interviews and focus groups were 
used minimally. 

Figure 2. Data Collection Methods Used in 2007-2008 Research 



Count 

0 5 10 15 20 25 30 




State Policy 1 



Note: One of the 40 studies contained more than one category of data collection method. 
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When data collection or assessment instruments were used in research, a number of approaches 
were used. As shown in Table 3, researchers: (a) developed their own non-test protocols, (b) 
used norm-referenced academic achievement measures, (c) used researcher or professionally 
developed tests; (d) used state criterion-referenced assessments, or (e) used norm-referenced 
cognitive ability measures. In general, researchers tended to use either researcher-developed 
non-test protocols or norm-referenced academic achievement measures. A complete listing of 
the instruments used in each of the studies is provided in Appendix C. 



Table 3. Assessment/Data Collection Instruments 



Instrument Type 


Count 3 


Researcher-developed non-test proto- 
cols 


18 


Norm-referenced academic achieve- 
ment measures 


13 


Researcher or professionally developed 
tests 


9 


State criterion-referenced assessment 


9 


Norm-referenced cognitive ability mea- 
sures 


3 


Total 


52 



a Eight of the studies used more than one data collection tool, with the number ranging from 2 to 4. 

Content Area Assessed 

A number of studies conducted during 2007-2008 focused on accommodations used in certain 
academic content areas. As shown in Table 4, math and reading were the two most commonly 
assessed content areas. Table 4 also provides a comparison to content areas in NCEO’s previous 
report on accommodations (Zenisky & Sireci, 2007). In general, the emphasis on reading and 
math is consistent across reviews. A change in the emphasis on “other language arts” and an 
increase in reading studies is apparent across years. Only one study did not specify its content 
area for 2007-2008, whereas seven did not do so in 2005-2006. 

Number of Research Participants 

Table 5 shows information on the size and composition of the samples used in the research 
on accommodations during 2007 and 2008; this information is provided in more detail in Ap- 
pendix D. A good portion of the research studies included sample sizes with more than 300 
participants ( n = 18). Samples included both students with and without disabilities (students 
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with disabilities = 0%-24%) or focused specifically on students with disabilities (75%-100%). 
Research with small sample sizes (N < 100) tended to have a high percentage of students with 
disabilities included (75%-100% students with disabilities). Four studies not investigating 
differences between students with disabilities and students without disabilities did not report 
disability information; these all consisted of large sample sizes (N > 300). 



Table 4. Academic Content Areas Involved 



Content Areas Assessed 


2005-2006 3 


2007-2008 b 


Mathematics 


17 


15 


Reading 


14 


18 


Writing 


4 


4 


Other Language Arts 0 


9 


4 


Science 


1 


3 


Social Studies 


1 


1 


Civics/US History 


1 


0 


Psychology 


1 


1 


Not Specific 


7 


1 



a 14 studies in 2005-2006 included examinations of more than one content area, with the number ranging from 2 
to 6. 

b 1 0 studies in 2007-2008 included examinations of more than one content area, with the number ranging from 2 
to 4. 

c Other Language Arts assessment areas include English Language Proficiency, Literature, Writing, and General 
Language Skills. 



Table 5. Sample Sizes in Studies of Varying Numbers of Research Participants 



Total Number 
of Research 
Participants 


Percent of Sample Consisting of Individuals with Disabilities 


0-24% 


25-49% 


50-74% 


75-100% 


Not reported 


Not applicable 3 


Total 


1-10 


- 


- 


- 


2 


- 


- 


2 


11-100 


- 


- 


2 


4 


- 


3 


9 


101-300 


2 


1 


1 


2 


- 


3 


9 


More than 
300 


6 


1 


2 


3 


4 


2 


18 


Not appli- 
cable* 


- 


- 


- 


- 


- 


2 


2 


Total 


8 


2 


5 


11 


4 


10 


40 



a These studies included either (a) literature reviews of multiple studies where samples varied widely across the 
multiple studies, or (b) research studies that did not include students directly as the unit of analysis (e.g., they 
reported data from parents or teachers or aggregated results at the school or state level). 
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School Level 



Research on accommodations during 2007 and 2008 involved participants who were K-12 stu- 
dents. Specifically, as seen in Table 6, five studies involved only elementary school students, 
five involved only middle school students, and three involved only high school students. A 
large proportion of K-12 studies involved samples across multiple educational levels; most of 
these included large sample sizes and secondary data sources. Although not more common than 
K-12 studies, there were a noteworthy number of studies that examined accommodations use 
and implementation at the post-secondary level. Ten studies did not use students in the research 
sample. 



Table 6. Grade Level of Research Participants 



Education Level of Participants 
in Studies 


Number of Studies 


Elementary school (K-5) 


5 


Middle school (6-8) 


5 


High school (9-12) 


3 


Postsecondary 


6 


Multiple grade levels 


11 


Not applicable 


10 



Disability Categories 

A broad range of disability categories were included in samples in the 2007-2008 research (see 
Appendix E for details). As shown in Table 7, nine studies did not specify disability categories 
included, and 10 studies did not include students in the sample. Of the remaining 21 studies, 
the most commonly studied disability category was learning disabilities ( n = 15). Students with 
hearing or visual impairments, or multiple disabilities were included in five of the 30 pieces of 
research that included a student sample and specified information about specific disabilities. 
Students with speech/language disabilities, emotional behavior disabilities, and attention prob- 
lems were included in the sample of at least three studies. 
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Table 7. Disabilities Reported in Research Participants 



Disabilities Observed in Research 
Participants 


Number of Studies 3 


Learning disabilities 


15 


Hearing or visual impairment 


5 


Multiple disabilities 15 


5 


Speech/Language 


4 


Emotional behavioral disability 


4 


Attention problem 


3 


Mental retardation 


2 


Not reported/unspecified 


9 


Not applicable 


10 



a Some studies were included in multiple categories, if applicable. Specifically, 7 studies had multiple disability 
categories listed, with a range from 3 to 13 categories in a study. 

b The category “Multiple Disabilities” indicates that the students were in the category of multiple disabilities, not 
that multiple individual disabilities were in the study. 



Types of Accommodations 

The number of times specific categories of accommodations were included in 2007-2008 research 
is summarized in Table 8. Presentation accommodations were the most commonly studied ( n = 
25), and within this category the most common accommodations were read aloud ( n = 9) and 
computer administration (n = 6). Within the next most frequent category studied in 2007-2008, 
timing/scheduling, extended time ( n = 10) was the most frequent. A complete listing of the ac- 
commodations research is in Appendix E. 



Table 8. Accommodations in Reviewed Research 



Accommodation Category 


Number of Studies 


Presentation 


25 


Equipment/Materials 


7 


Response 


3 


Timing/Scheduling 


14 


Setting 


3 


Other 3 


8 



a The “Other” category includes research on accommodations not included in typical policies or research that did 
not specify the accommodations studied. 
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Research Findings 



The findings of the accommodations research from 2007-2008 are summarized in Tables 9-11. 
They also are presented in greater detail in Appendix F. Research on the most commonly studied 
accommodations is presented in Table 9. The read aloud accommodation exemplifies the mixed 
results evident in many of the accommodations studies. Two studies found that scores on tests 
were higher with the use of this accommodation. Three studies indicated that the accommoda- 
tion provided a differential boost to students with disabilities. One study found that differential 
boost applied to students without disabilities rather than those with disabilities. An additional 
study found that the read aloud accommodation made the test easier (i.e., changed the difficulty 
level). Another study found that the read aloud accommodation did not increase test scores 
as there was no significant difference in student performance between scores of students who 
used the read aloud accommodation and those who participated in the assessment without the 
accommodation. 

Computer-based testing studies were the most consistent in their results in the 2007-2008 re- 
search. Six studies during the two year period investigated the comparability of scores from 
computer-based and paper-pencil formats. Five of them found that scores were comparable. 
One found that scores were not comparable, with the computer-based format more difficult. 

Extended time is another accommodation for which there is a body of work during 2007 and 
2008. In the past, this accommodation generally has shown a differential boost to students with 
disabilities compared to students without disabilities (Johnstone et al., 2006; Zenisky et al., 
2007). Studies during 2007-2008 did not necessarily support this finding, with two studies not 
supporting the differential boost hypothesis. Other studies found that item completion takes more 
time for students using magnification and for students with disabilities writing expository essays. 
One study found that scores were comparable for extended time and no extended time tests. 
Another study found that test anxiety had a negative effect on scores for tests that were timed. 

Aggregated accommodations were examined in five studies. Two of these studies found that 
accommodations had mixed effects on the performance of students with disabilities. Others 
found that accommodated and non-accommodated test forms were not comparable, and that 
accommodations did not level the playing field on college entrance exams. Finally one study 
found that accommodations had a positive effect on scores and provided a differential boost to 
scores of student with disabilities. 
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Table 9. Summary of Research Findings for Most Commonly Studied Accommodations 



Accommodation 

Studied 


Finding 


Number of 
Studies 


Read aloud 


Read aloud provides differential boost 


3 


Read aloud increases test performance 


2 


Read aloud makes items easier, or provides boost to those without 
disabilities 


2 


Read aloud does not increase test performance 


1 


Computer 


Scores comparable 


5 


Scores not comparable 


1 


Extended Time 


Results did not support differential boost hypothesis 


2 


Magnification increases time needed to finish items 


1 


Students with disabilities use extra time writing expository essays 


1 


Scores comparable 


1 


Scores predicted by test anxiety in timed conditions 


1 


Aggregated 


Accommodations had mixed effects on performance of students 
with disabilities 


2 


Accommodations had a positive effect on scores for students with 
disabilities only 


1 


Performance not comparable between students with disabilities and 
without disabilities 


1 


Accommodations not serving to level the playing field on college 
entrance exam 


1 


Segmented Text 


Segmented text did not positively affect test scores 


1 


Scores on computer-based tests taken without segmented text were 
lower than those with segmented text 


1 



Studies on the implementation of accommodations are shown in Table 10. These studies also 
show mixed results. These studies show that, in general, accommodations are used frequently 
in assessment, though their frequency and reasons for use are variable. One study identified the 
need for a decision-making model to aid practitioners in standardizing their practices. 

Table 1 1 shows the results of research on perceptions about accommodations. In some studies, 
teachers and other professionals reported confidence in their knowledge and ability to appro- 
priately use and implement accommodations. In other studies, researchers indicated a need for 
improvement in training to strengthen knowledge in this area. 
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Table 10. Summary of Research Findings on the Implementation of Accommodations 



Study Findings 


Number of 
Studies 


States are beginning to form written accommodations policy for students with dis- 
abilities taking ELP exams 


1 


The provision of accommodations varies depending on context 


1 


Accommodations use increased overtime, as did match with those used during 
instruction 


1 


Variability in student and teacher recollection of accommodations provided 


1 


Students use accommodations in combination in an effort to level playing field 


1 


Inconsistency between accommodations prescribed by lEPs and teacher’s rec- 
ommendations 


1 


Students in medical school do not typically request or receive accommodations 
for assessment 


1 


A decision-making model would be appropriate 


1 



Table 11. Summary of Research Findings on Perceptions about Accommodations 



Study Findings 


Number of 
Studies 


Perceptions related to assistive technology vary 


1 


Educators confident in accommodations knowledge 


1 


Interpretation of accommodations definitions vary 


1 


Accommodations perceived as valid and easy to use 


1 


Accommodations perceived as underused 


1 



Limitations and Future Research 

As is often the case in research, many of the studies reviewed discussed limitations in order to 
provide context for the results that were observed (n = 38). As seen in Table 12, limitations were 
summarized under four broad categories. A study was counted for a given category as long as 
it provided at least one limitation under that category. A more comprehensive description of 
limitations for each individual study is available in Appendix G. 

In general, more studies recognized sample characteristics as a limitation to the research. Specifi- 
cally, common limitations were sample size and the representativeness of the samples obtained 
on variables such as age, grade level, and race. Another common limitation was methodology 
where frequently the use of non-experimental research designs and non-random sampling of 
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participants were referenced. More detailed information regarding specific limitations of each 
study is also available in Appendix G-l. 

Table 12. Categorized Limitations Identified by Authors 



Limitation category 


Number of Studies 3 


Sample characteristics 


19 


Methodology 


14 


Test/testing context 


12 


Results 


8 


No limitations listed 


2 



a Ten studies included more than one category of limitations, represented in 2 or 3 limitations 
categories. 



As would be expected, sample characteristics and methodology context were also often high- 
lighted as areas that needed to be addressed in future research — as seen in Table 13. However, 
we found that researchers recognized more instances where the results of the study led to im- 
plications for future research than was the case when identifying limitations (Table 12). More 
detailed information regarding suggestions for future research is also available in Appendix G-2. 



Table 13. Categorized Areas of Future Research Identified by Authors 



Future Research 


Number of Studies 3 


Methodology 


16 


Results 


13 


Sample characteristics 


12 


Test/Test context 


9 


No future directions Llisted 


1 



a Nine studies listed directions for future research that fit into multiple categories. 



The present synthesis of accommodations research produced several findings that were not en- 
tirely unexpected. First, given the national focus on the large-scale assessment of core content 
areas — mathematics and reading — in recent years, it is not surprising to see that these content 
areas were by far the most studied. It also appeared that research studies are becoming more 
specific in the content areas that are being covered. This is consistent with the trend in state 
efforts to differentiate between content areas in state assessment participation and accommoda- 
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tions guidelines (Christensen, Lazarus, Crone, & Thurlow, 2008). Also, students with learning 
disabilities (LD) were most likely to be included in research samples, which is likely as LD is 
the most prevalent disability category. In addition, most of these students use accommodations 
to access the regular assessment. 

When looking at the findings for a specific accommodation, results were often mixed. This is 
consistent with findings from previous syntheses of accommodations research that used the 
same methodology (Johnstone et al., 2006; Thompson, Blount, & Thurlow, 2002; Zenisky et al., 

2007) . One accommodation that began to show consistent findings across studies was computer 
based assessments. These were found to be equivalent to paper-and-pencil formats of tests by 
five studies. Still, this test change is quickly losing its status as an accommodation and becoming 
a primary or secondary testing platform for all students regardless of disability status. Another 
finding was a decrease in studies investigating the extended time accommodation. Although this 
accommodation was studied frequently in the past, it has lost its place as an accommodation in 
many states because of a move to untimed tests. 

The testing of educational achievement in the United States will likely continue in the years to 
come. It also is likely that there will be a continued need for accommodations research to inform 
the use of accommodations for the assessment of students with disabilities. 

This report can be used as a snapshot of current purposes of research, research type and data 
collection source, assessment or data collection focus, characteristics of the independent and 
dependent variables under study, comparability of findings between studies in similar domains, 
and limitations and directions of future research. It becomes evident that although there are 
certain accommodations that will continue to be explored, there also will be the opportunity 
for the development of new avenues to providing equal access to all students, such as Universal 
Design for Assessment (Dolan, Hall, Banerjee, Chun, & Strangman, 2005; Johnstone, Altman, 
& Thurlow, 2006; Ketterlin-Geller, 2008) adaptive testing (Frey & Seitz, 2009; Lee, Ip, & Fuh, 

2008) , and the use of technology in assessment. 

As many states initiate computer-based assessments, individual tracking of scores across years, 
and adaptive testing, new issues related to access and the validity of inferences will emerge. 
This continued evolution will likely occur on many levels in response to changes in educational 
policy, educational needs, and population characteristics — which will in turn bring about new 
challenges to those conducting research on accommodations. 
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Appendix A«^— 

Research Purposes 



Table A-1. Purpose Category: Compare Scores from Standard/Nonstandard Administration 
Condition 



Author(s) 


Stated Research Purpose 


Bennett et al. (2008) 


Investigate the comparability of scores from paper- and computer-based 
tests. 


Bolt &Thurlow (2007) 


Examine data on accommodated and non-accommodated performances of 
students using the read aloud accommodation. 


Bolt & Ysseldyke (2008) 


Evaluate measurement comparability for two groups of accommodated stu- 
dents with disabilities (i.e., accommodated students with physical disabili- 
ties and accommodated students with mental disabilities) using differential 
item functioning (DIF) analysis and systematically compare a reference 
group of non-accommodated students without disabilities. 


Elbaum (2007) 


Compare the performance of students with and without learning disabilities 
(LD) on a mathematics test using a standard administration procedure and 
a read aloud accommodation. 


Harris (2008) 


Evaluate two administration modes were compared in terms of test factorial 
structure and student performance: 1) read-aloud administration delivered 
by a teacher following an oral script, 2) computer deliver of the oral script 
by CD-ROM. 


Keng et al. (2008) 


Describe a comparative study conducted at the item level for paper and 
online administrations of a statewide high stakes assessment. 


Ketterlin-Geller, Yovanoff 
et al. (2007) 


Investigate the effects of item characteristics on lower and higher readers’ 
differential benefit for two reading-based accommodations, read aloud and 
simplified language. 


Kim & Huynh (2008) 


Compare student performance between paper-and-pencil testing (PPT) 
and computer-based testing (CBT). 


Kim & Huynh (2007) 


Examine the comparability of student scores obtained from computerized 
and paper-and-pencil formats. 


Lee et al. (2008) 


Explore the relationship between computer-paced and student-paced item 
presentation on the academic test performance in college students diag- 
nosed with ADHD. 


Puhan et al. (2007) 


Evaluate the comparability of two versions of a certification test: a paper- 
and-pencil test (PPT) and computer-based test (CBT). 
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Table A-2. Purpose Category: Investigate the Effect on Scores from Accommodated 
Administration Conditions 



Author(s) 


Stated Research Purpose 


Abedi et al. (2008) 


Explore accessibility by using reading comprehension passages that were 
broken down into shorter “segments” or “chunks”. 


Brown, W.M. (2007) 


Examine the read aloud accommodation, and an accommodation in which 
the text response options (distracters and key) were replaced with graphics 
or pictures (graphically interpreted response options, or GIRO). 


DiRosa (2007) 


Provide empirically based insight into the effects of testing accommoda- 
tions on individual student performance. 


Enriquez (2008) 


Examine the extent to which linguistic accommodation led to improvement 
in test performance of ELLs using ELP scores from the Colorado English 
Language Acquisition Assessment (CELApro) and Mathematics scores 
from the Colorado Student Assessment Program (CSAP) along with stu- 
dent background variables. 


Gregg et al. (2007) 


(a) Investigate the influence of timed essay writing on the handwritten, 
typed, and typed/edited formats of an expository essay on the quality 
scores received by students; (b) Examine the contribution of spelling, 
handwriting, fluency, and vocabulary complexity to the quality scores that 
students with and without dyslexia received on the same writing task. 


Jerome (2007) 


Examine the use of test accommodations and their impact on the statewide 
performance of students with disabilities. 


Kamei-Hannan (2008) 


Examine the accessibility barriers of a computerized adapted test called 
the Measure of Academic Performance. 


Lang et al. (2008) 


Examine the effects of up to 67 testing accommodations on students’ test 
performances and reactions to the use of testing accommodations. 


Lewandowski et al. 
(2007) 


Examine the effects of an extended time (time and one-half) accommoda- 
tion. 


Lewandowski et al. 
(2008) 


Examine the effect of extended time. 


Lovett (2008) 


Examine factors that may influence students’ timed exam performance. 


Middleton (2007) 


Examine the effects of a read-aloud accommodation provided to students. 
It also examined the appropriateness of the read-aloud accommodation. 


Temple (2007) 


Examine an effect of read-alouds on reading achievement. 


































Table A-3. Purpose Category: Investigate Test Validity Under Accommodated Conditions 



Author(s) 


Stated Research Purpose 


Lindstrom & 
Gregg (2007) 


Generate information about the validity of inferences that can be made from 
scores obtained from extended time test administrations for students with disabili- 
ties. 



Table A-4. Purpose Category: Report on Implementation Practices and Test Accommodations 
Use 



Author(s) 


Stated Research Purpose 


Albus & Thurlow 
(2008) 


Highlight the policy differences across states in the accommodations offered and 
also provides information on state-specific policies. 


Atchison (2008) 


Gather and analyze data on the subject of using assistive technology as an ac- 
commodation on Colorado State Assessment Project (CSAP) testing. 


Bottsford-Miller 

(2008) 


Examine the relationship between accommodations and modifications specified 
on student lEPs, and 504 plans to those provided. 


Cawthon (2008) 


Investigate the types of testing accommodations used on 2004-2005 statewide 
standardized assessments as well as recommendations for best practices. 


Finizio (2008) 


Examine the match between instructional and assessment accommodations on 
the lEPs of 39 students 


Ketterlin-Geller, 
Alonzo et al. 
(2007) 


Investigate the consistency of accommodation assignments for students with 
lEPs. 


Sack, et al. 
(2008) 


Determine the number of students requesting accommodation for a disability, the 
time at which the request was made, the type of disability, and the type of accom- 
modation offered. 


Wolf (2007) 


(a) Document the use of testing accommodations by students who are deaf or 
hard of hearing (D/HH); (b) Identify the types and frequency of testing accom- 
modations required by D/HH students attending general education classes in Ari- 
zona public schools; and (c) Analyze the relationships between type and degree 
of hearing loss and SAT-9 achievement for students who are D/HH in Arizona 
public schools. 



Table A-5. Purpose Category: Review Literature on Test Accommodations for Effects on 
Scores and Assessment Practices 



Author(s) 


Stated Research Purpose 


Wang et al. 
(2007) 


Conduct a meta-analysis of computer-based and paper-and-pencil administration 
mode effects on K-12 student mathematics tests. 
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Table A-6. Purpose Category: Identify Predictors of the Need forTest Accommodation(s) 



Author(s) 


Stated Research Purpose 


Tindal et al. 
(2008) 


Investigate the reliability and utility of the Accommodation Station (AS), an online 
decision-making model that helps IEP teams determine which testing accommoda- 
tions are appropriate for individual students with disabilities. 



Table A-7. Purpose Category: Study or Compare Perceptions of Accommodation Use 



Author(s) 


Stated Research Purpose 


Brown, D.W. 
(2007) 


Examine teachers’ perceptions and knowledge of test accommodations for students 
with disabilities. 


Byrnes 

(2008) 


Examine interpretations of three frequently used accommodations. 


Hadjikakou & 
Hartas (2008) 


Explore the experiences of students with disabilities and the views of their tutors 
and Heads of private tertiary education institutions in Cyprus. 


Sharoni & 
Vogel (2007) 


Examine the percentage of students with testing accommodations among Israeli 
entrance exam participants. 


Woods (2007) 


Investigate special education specialist opinions regarding the manageability of a 
variety of accommodations on a nationwide large-scale assessment. 
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Appendix B 

Research Characteristics 



Table B-1. Reference Types, Research Types, Research Designs, Data Collection Sources, and 
Collection Instruments 



Authors 


Reference Type 


Research Type 


Research 

Design 


Data 

Collection 

Source 


Collection 

Instrument 


Abedi et al. 
(2008) 


Report 


Mixed 


Quasi-experi- 

mental 


Primary 


Focus group, 
Test, Survey 


Albus & 
Thurlow 
(2008) 


Journal 


Qualitative 


Descriptive 

Qualitative 


Primary 


State Policy 
Documents 


Atchison 

(2008) 


Dissertation 


Mixed 


Descriptive 

Quantitative 


Primary 


Survey 


Bennett et al. 
(2008) 


Journal 


Quantitative 


Quasi-experi- 

mental 


Secondary 


Test 


Bolt & 

Thurlow 

(2007) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Bolt & 
Ysseldyke 
(2008) 


Journal 


Quantitative 


Quasi-experi- 

mental 


Secondary 


Test 


Bottsford- 
Miller (2008) 


Dissertation 


Mixed 


Descriptive 

Quantitative 


Secondary 


Test 


Brown, D.W. 
(2007) 


Dissertation 


Quantitative 


Quasi-Experi- 

mental 


Primary 


Test 


Brown, W.M. 
(2007) 


Dissertation 


Quantitative 


Descriptive 

Quantitative 


Primary 


Survey 


Byrnes 

(2008) 


Journal 


Qualitative 


Descriptive 

Qualitative 


Primary 


Survey 


Cawthon 

(2008) 


Journal 


Quantitative 


Descriptive 

Qualitative 


Secondary 


Survey 


DiRosa 

(2007) 


Dissertation 


Quantitative 


Descriptive 

Quantitative 


Primary 


Test 


Elbaum 

(2007) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Primary 


Test 


Enriquez 

(2008) 


Dissertation 


Quantitative 


Correlation/ 

Prediction 


Secondary 


Test 


Finizio (2008) 


Dissertation 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Gregg et al. 
(2007) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Primary 


Test 
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Authors 


Reference Type 


Research Type 


Research 

Design 


Data 

Collection 

Source 


Collection 

Instrument 


Hadjikakou 
& Hartas 
(2008) 


Journal 


Qualitative 


Descriptive 

Qualitative 


Primary 


Focus group 


Harris (2008) 


Dissertation 


Quantitative 


Correlation/ 

Prediction 


Secondary 


Test 


Jerome 

(2008) 


Dissertation 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Kamei- 

Hannan 

(2008) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Primary 


Test 


Keng et al. 
(2008) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Ketterlin- 
Geller, 
Alonzo et al. 
(2007) 


Journal 


Qualitative 


Descriptive 

Qualitative 


Primary 


Survey 


Ketterlin- 
Geller, 
Yovanoff et 
al. (2007) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Primary 


Test 


Kim & Huynh 
(2007) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Kim & Huynh 
(2008) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Lang et al. 
(2008) 


Journal 


Mixed 


Quasi-experi- 

mental 


Primary 


Test 


Lee et al. 
(2008) 


Journal 


Mixed 


Quasi-Experi- 

mental 


Primary 


Interview Pro- 
tocol 


Lewandowski 
et al. (2008) 


Journal 


Quantitative 


Quasi-experi- 

mental 


Primary 


Test 


Lewandowski 
et al. (2007) 


Journal 


Quantitative 


Quasi-Experi- 

mental 


Primary 


Test 


Lindstrom & 
Gregg (2007) 


Journal 


Quantitative 


Quasi-Experi- 

mental 


Secondary 


Test 


Lovett (2008) 


Dissertation 


Quantitative 


Quasi-experi- 

mental 


Primary 


Test 


Middleton 

(2007) 


Dissertation 


Quantitative 


Descriptive 

Quantitative 


Primary 


Test 


Puhan et al. 
(2007) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Sack et al. 
(2008) 


Journal 


Qualitative 


descriptive 

qualitative 


Primary 


Interview Pro- 
tocol 























































































































Authors 


Reference Type 


Research Type 


Research 

Design 


Data 

Collection 

Source 


Collection 

Instrument 


Sharoni & 
Vogel (2007) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Temple 

(2007) 


Dissertation 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Tests 


Tindal et al. 
(2008) 


Report 


Quantitative 


Descriptive 

Quantitative 


Primary 


Survey 


Wang et al. 
(2007) 


Journal 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Wolf (2007) 


Dissertation 


Quantitative 


Descriptive 

Quantitative 


Secondary 


Test 


Woods 

(2007) 


Journal 


Mixed 


Descriptive 

Quantitative 


Primary 


Survey 















































Appendix C 

Assessment/Instrument Characteristics 

Table C-1. Assessment/Instrument Types and Specific Assessments/Instruments Used 



Authors 


Researcher- 
Developed Non- 
Test Protocols 


Norm- 

Referenced 

Cognitive 

Ability 

Measures 


Norm- 

referenced 

Academic 

Achievement 

Measures 


State 

Criterion- 

referenced 

Assessment 


Researcher or 
Professionally 
Developed 
Tests 


Abedi et al. 
(2008) 


Student back- 
ground questions, 
student motiva- 
tion scale, stu- 
dent background 
questionnaire for 
teachers 








Researcher 
developed test 


Albus & 
Thurlow (2008) 


Researcher de- 
veloped evalua- 
tion protocol 










Atchison 

(2008) 


Survey to mea- 
sure the attitudes 
and knowledge 
of educators and 
special service 
providers 










Bennett et al. 
(2008) 






Twenty ques- 
tions from 
NAEP 2000 as- 
sessment in pa- 
per and pencil 
and computer 
based formats 




Tutorial with 
embedded 
tasks measur- 
ing computer 
skill 


Bolt & Thurlow 
(2007) 








Statewide as- 
sessment 




Bolt & 
Ysseldyke 
(2008) 








Statewide as- 
sessment 




Bottsford-Miller 

(2008) 


Teacher survey, 
student survey 


Woodcock- 
Johnson III 








Brown, D.W. 
(2007) 










Researcher 
developed test 


Brown, W.M. 
(2007) 


Survey 










Byrnes (2008) 


A single-sheet 
survey 
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Authors 



Lewandowski 
et al. (2008) 



Lewandowski 
et al. (2007) 



Lindstrom & 
Gregg (2007) 



Lovett (2008) 



Middleton 

(2007) 



Puhan et al. 
(2007) 



Sack et al. 
(2008) 



Sharoni & 
Vogel (2007) 



Researcher- 
Developed Non- 
Test Protocols 



Interview 



Questionnaire 
regarding level of 
satisfaction 



Norm- 

Referenced 

Cognitive 

Ability 

Measures 



Background 
questionnaire, 
ADHD rating 
scale, behavior 
rating inventory 
of executive func- 
tion 



Self-Evaluation of 
Performance on 
Timed Academic 
Reading, Revised 
Version, Test 
Anxiety Inventory 



Processing 
speed index of 
the Wechsler in- 
telligence scale 
for children, 
fourth edition 



Wechsler Adult 

Intelligence 

Scale 



Norm- 

referenced 

Academic 

Achievement 

Measures 



Reading Flu- 
ency subtest of 
the Woodcock- 
Johnson Tests 
of Achievement, 
Third Edition; 
Standard form 
of the Raven 
Progressive 
Matrices test; 
Nelson-Denny 
Reading Test 



Mathematics 
Fluency subtest 
of Form A of 
the Woodcock- 
Johnson Tests 
of Achievement, 
Third Edition 



The SAT test 



Woodcock- 
Johnson III, 
Nelson-Denny 
reading test 



Reading com- 
prehension test 



Large scale 
certification 
test from the 
Praxis™ pro- 
gram 



The “saf” col- 
lege entrance 
exam of 2003 



State 

Criterion- 

referenced 

Assessment 



Researcher or 
Professionally 
Developed 
Tests 



Mathematics 
calculation test 
developed for 
the study 
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Authors 



Temple (2007) 



Tindal et al. 
(2008) 



Wang et al. 
(2007) 



Wolf (2007) 



Woods (2007) 



Researcher- 
Developed Non- 
Test Protocols 



Researchers con- 
ducted literature 
studies through 
read-alouds 



Survey 




Open-ended 

questionnaire 



18 



Norm- 

Referenced 

Cognitive 

Ability 

Measures 




Norm- 

referenced 

Academic 

Achievement 

Measures 


State 

Criterion- 

referenced 

Assessment 


Researcher or 
Professionally 
Developed 
Tests 


The Scholas- 
tic Reading 
Inventory Lexile 
Levels (SRI); 
the Florida 
Comprehensive 
Norm Refer- 
ence Test Scale 
Scores (FCAT/ 
NRT) 


Florida State 
Fluency Probes 
(FORF), the 
Florida Com- 
prehensive 
Achievement 
Test in Reading 
(FCAT) 


The teacher 
created tests 
on the literature 
during the pe- 
riod 2006-2007 




Table C-2. Content Areas Assessed 



Author(s) 



Abedi et al. 
(2008) 



Albus & 
Thurlow (2008) 



Atchison b (2008) 



Bennett et al. 
(2008) 



Bolt & Thurlow 
(2007) 



Bolt & 
Ysseldyke 
(2008) 



Bottsford-Miller 

(2008) 



Brown, D.W. 
(2007) 



Brown, W.M. b 
(2007) 



Civics/ 

US 

History 



Not 

Psychology Specific 
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Author(s) 


Math 


Reading 


Writing 


Other 

LA a 


Science 


Social 

Studies 


Civics/ 

US 

History 


Psychology 


Not 

Specific 


N 


Sack, et al b 
(2008) 




















0 


Sharoni & Vogel 
(2007) 


















• 


1 


Temple (2007) 




• 
















1 


Tindal et al. b 
(2008) 




















0 


Wang et al. b 
(2007) 




















0 


Wolf (2007) 




• 




• 












2 


Woods b (2007) 




















0 


Total 


15 


18 


4 


4 


3 


1 


0 


1 


1 





a Other Language Arts assessment areas include English Language Proficiency, Literature, Writing, and General 
Language Skills. 

b Study was not applicable to choosing a content area assessed (for example, a survey of teacher perceptions). 
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Appendix D 

Participant and Sample Characteristics 



Table D-1. Unit of Analysis, Total Sample Sizes (Students, Parents, Schools, Articles, and 
Teachers), Grade/Education Level, and Types of Disabilities 



Authors 


Unit of 
Analysis 


Sample 

Size 


Percent of 
Sample with 
Disabilities 


Grade/ 

Education 

Level 


Disability Categories Included 
in Sample * 


Abedi et al. 
(2008) 


Students 


738 


15.9% 


Middle School 


LD, hearing impairment, autism, 
SL, other health impairment 


Albus & Thurlow 
(2008) 


N/A 


N/A 


N/A 


N/A 


N/A 


Atchison (2008) 


Teachers 


31 


N/A 


N/A 


N/A 


Bennett et al. 
(2008) 


Students 


1,970 


Not reported 


Middle 

School 


Not reported 


Bolt & Thurlow 
(2007) 


Students 


4,435 


100.0% 


Elementary & 
Middle School 


LD 


Bolt & 
Ysseldyke 
(2008) 


Students 


37,350 


5.4% 


Elementary & 
Middle School 


LD, mental retardation, EBD, 
deaf, blind, deaf-blind, hard of 
hearing, and PD 


Bottsford-Miller 

(2008) 


Students 


5,794 


100.0% 


Elementary & 
Middle School 


LD, speech impairment, mental 
retardation, EBD, visual impair- 
ment, other health impairment, 
hearing impairment, MD, autism, 
orthopedic impairment, traumatic 
brain injury, developmental delay, 
deaf/blindness 


Brown, D.W. 
(2007) 


Students 


868 


8.5% 


Elementary 


LD 


Brown, W.M. 
(2007) 


Teachers 


262 


N/A 


N/A 


N/A 


Byrnes (2008) 


Teachers 


45 


N/A 


N/A 


N/A 


Cawthon (2008) 


Teachers 


444 


N/A 


N/A 


N/A 


DiRosa (2007) 


Students 


10 


100.0% 


College 


LD 


Elbaum (2007) 


Students 


625 


62.0% 


Middle School 
& High School 


LD 


Enriquez (2008) 


Students 


72,573 


12.0% 


Multiple Lev- 
els 


Unspecified disabilities 


Finizio (2008) 


Students 


38 


100.0% 


Elementary & 
Middle School 


Unspecified disabilities 


Gregg et al. 
(2007) 


Students 


130 


50.0% 


College 


LD 


Hadjikakou & 
Hartas (2008) 


Students 


10 


100.0% 


College 


Hearing impaired, PD, LD, visual 
impairment, MD 
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Authors 


Unit of 
Analysis 


Sample 

Size 


Percent of 
Sample with 
Disabilities 


Grade/ 

Education 

Level 


Disability Categories Included 
in Sample * 


Harris (2008) 


Students 


5,835 


100.0% 


Middle School 


MD 


Jerome (2008) 


Students 


314,766 


14.5% 


Elementary 


MD 


Kamei-Hannan 

(2008) 


Students 


49 


100.0% 


Multiple Lev- 
els 


Unspecified disabilities 


Keng et al. 
(2008) 


Students 


15,593 


Not reported 


Middle School 
& High School 


Not reported 


Ketterlin-Geller, 
Alonzo et al. 
(2007) 


Students 

and 

Teachers 


38 Stu- 
dents/ 
14 

Teach- 

ers 


100.0% 


Elementary 


EBD, LD, MD, S/L 


Ketterlin-Geller, 
Yovanoff et al. 
(2007) 


Students 


160 


17.5% 


Elementary 


EBD, LD, S/L 


Kim & Huynh 
(2007) 


Students 


1,194 


Not reported 


High School 


Not reported 


Kim & Huynh 
(2008) 


Students 


439 


Not reported 


Middle School 
& High School 


Not reported 


Lang et al. 
(2008) 


Students 


170 


44.0% 


Elementary 


Unspecified disabilities 


Lee et al. (2008) 


Students 


21 


100.0% 


College 


AP 


Lewandowski et 
al. (2008) 


Students 


64 


50.0% 


High School 


LD 


Lewandowski et 
al. (2007) 


Students 


54 


50.0% 


Middle School 


AP 


Lindstrom & 
Gregg (2007) 


Students 


4,952 


50.0% 


High School 


AP, LD, MD 


Lovett (2008) 


Students 


225 


0.0% 


College 


No disability 


Middleton 

(2007) 


Students 


2,028 


44.5% 


Elementary & 
Middle School 


LD (RD) 


Puhan et al. 
(2007) 


Adults 


5,308 


N/A 


N/A 


N/A 


Sack et al. 
(2008) 


Medical 

Schools 


126 


N/A 


N/A 


N/A 


Sharoni & Vogel 
(2007) 


Students 


4,851 


8.5% 


College 


LD 


Temple (2007) 


Students 


175 


100.0% 


Middle School 


Unspecified disabilities 


Tindal et al. 
(2008) 


Teachers 


140 


N/A 


N/A 


N/A 



































































































































Authors 


Unit of 
Analysis 


Sample 

Size 


Percent of 
Sample with 
Disabilities 


Grade/ 

Education 

Level 


Disability Categories Included 
in Sample * 


Wang et al. 
(2007) 


Meta- 

Analysis 


N/A 


N/A 


N/A 


N/A 


Wolf (2007) 


Students 


115 


100.0% 


Elementary & 
Middle School 


Hearing impaired 


Woods (2007) 


Teachers 


205 


N/A 


N/A 


N/A 



* Key: 

AP (Attention Problem) 

LD (Learning Disabilities) 

S/L (Speech/Language) 

MD (Multiple Disability) 

PD (Physical Disability) 

RD (Reading Deficit) 

EBD (Emotional or Behavioral Disability) 
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Appendix E 

Accommodations Studied 

Table E-1. Presentation Accommodations Researched by Study 



Authors 


Braille 


Computer 

Administra- 

tion 


Large 

Print 


Clarify 

Direc- 

tions 


Read 

Direc- 

tions 


Simplified 

Language 


Read 

Aloud 


Format 


Bolt & Thurlow 
(2007) 














• 




Brown D. W. 
(2007) 














• 


• 


Brown W. M. 
(2007) 






• 




• 




• 




Elbaum (2007) 














• 




Enriquez (2008) 














• 




Harris (2008) 




• 






• 








Kamei-Hannan 

(2008) 


• 


• 


• 












Keng et al. 
(2008) 




• 














Ketterlin-Geller, 
Alonzo et al. 
(2007) 














• 




Ketterlin-Geller, 
Yovanoff et al. 
(2007) 














• 




Kim & Huynh 
(2007) 




• 














Kim & Huynh 
(2008) 




• 














Lee et al. 
(2008) 




• 














Middleton 

(2007) 














• 




Sharoni & Vogel 
(2007) 






• 












Temple (2007) 














• 




Wolf (2007) 








• 


• 


• 






Total 


1 


6 


3 


1 


3 


1 


9 


1 
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Table E-2a. Equipment/Materials, Response, and Timing Accommodations Researched by 
Study 




Table E-2b. Equipment/Materials, Response, and Timing Accommodations Researched by 
Study 




42 



NCEO 



















































Table E-3. Setting and Other Accommodations Researched by Study 



Authors 



Abedi et al. 
(2008) 



Brown (2007) 



Byrnes (2008) 



Enriquez (2007) 



Ketterlin-Geller, 
Alonzo, et al 
(2007) 



Jerome (2008) a 



Lang et al. 
(2008) 



Lovett (2007) 



Sack, et al 
(2008) 



Tindal et al. 
(2007) 



Wang et al. 
(2007) 



Total 



Small 

Group 



Individual 



Specialized Preferential Isolated 
Setting Seating Test Setting 




Segmented 

passages 





Multiple 



Not specified 



Not specified 



Quiet room 



Not specified 



Not specified 



a Study did not isolate by accommodations but included all students tested on a statewide large scale assess- 
ment and all accommodations allowed by that state policy. 
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Appendix F 

Research Findings 

Table F-1. Findings for Studies where Accommodations were Aggregated 



The use of testing accommodations resulted in mixed effects on student scores 


DiRosa 

(2007) 


The accommodations were found to benefit some students with learning disabilities 
some of the time, but neither of the accommodations singularly or packaged benefited 
all of the students all of the time. 


Wolf 

(2007) 


Type of hearing loss was found to significantly affect reading achievement even when 
controlling fortesting accommodations. The use of testing accommodations resulted in 
mixed effects on student reading and language achievement performance. 


Accommodated and non-accommodated test forms were not comparable 


Bolt & 
Ysseldyke 
(2008) 


It appeared that measurement was not highly comparable across accommodated stu- 
dents with physical disabilities and non-accommodated students without disabilities. 


Accommodations had a positive effect on scores and provided a differential boost to scores 
of students with disabilities 


Lang et al. 
(2008) 


The findings indicated testing accommodations overall had a positive impact on stu- 
dents’ individual reading and math scores. Furthermore, testing accommodations had 
a differential positive effect on reading scores for students with disabilities compared to 
students without disabilities. 


Accommodations did not level the playing field on college entrance exams and alternate 
admission criteria is advised 


Sharoni 
& Vogel 
(2007) 


Consideration of alternative admission criteria is recommended, given the fact that 
students with learning disabilities using accommodations in Israel did not achieve test 
scores comparable to those achieved by students without disabilities. 



Table F-2. Findings for Computer-based versus Paper-and-pencil assessment formats 



The scores obtained via computer-based assessment are comparable to those obtained via 
paper-and-pencil format 


Kim & 
Huynh 
(2007) 


Overall, the results supported the comparability of computerized and paper-based 
tests at the item level, subtest-level, and whole test-level in both subject areas. No 
evidence was found to suggest that the administration mode changed the construct 
being measured. 


Kim & 
Huynh 
(2008) 


The overall results suggested that scores obtained from PPT and CBT were compa- 
rable. 



NCEO 



45 



Lee et al. 
(2008) 


No significant differences were found in performance scores between the students 
tested under the two conditions. 


Wang et al. 
(2007) 


The results based on the final selected studies with homogeneous effect sizes show 
that the administration mode had no statistically significant effect on K-12 student 
mathematics tests. 


Puhan et 
al. (2007) 


Results indicated that the effect sizes were small (d < 0.20) and not statistically signifi- 
cant (p > 0.05). 


The scores obtained via computer-based assessment are NOT comparable to those obtained 
via paper-and-pencil format 


Bennett et 
al. (2008) 


Results showed that the computer-based mathematics test was significantly more dif- 
ficult statistically than the paper-based test. 



Table F-3. Findings for extended time versus standard time assessment formats 



Findings did not support the differential boost theory for students with disabilities (ADHD) 


Lewandowski 
et al. (2007) 


The results did not support the differential boost hypothesis in that the ADHD group 
did not make more gains than the control group with extended time. 


Lewandowski 
et al. (2008) 


Nondisabled students benefited more from the extended time than students with LDs 
did. However, extended time did allow students with LDs to attempt as many ques- 
tions as their nondisabled peers did under standard time conditions. 


The scores obtained via extra time are comparable to those obtained via standard time assess- 
ment format 


Lindstrom & 
Gregg (2007) 


Invariance across the two groups was supported for all parameters of interest, sug- 
gesting that the scores on the Critical Reading, Math, and Writing sections of the SAT 
Reasoning Test can be interpreted in the same way when students have an extended- 
time administration as opposed to the standard-time administration. 


Scores predicted by reading fluency, self-perception, and test anxiety when tests are adminis- 
tered under timed conditions 


Lovett (2008) 


In the best effort group, reading fluency and self-perceptions emerged as predictors of 
performance on the reading comprehension test, whereas test anxiety and processing 
speed did not add unique predictive value. Perceptions of performance on timed tests 
were predicted by test anxiety, even when reading fluency was controlled. 


As magnification level increases so does time needed to finish assessment 


Kamei- 

Hannan 

(2008) 


The results showed that as magnification increased, time on the test increased and 
students required visual efficiency skills. Students who used refreshable braille dis- 
plays were faced with several obstacles. 


Issues of vocabulary complexity, verbosity, spelling, and handwriting account for higher vari- 
ance in scores for students with disabilities (learning disabilities) than students without dis- 
abilities 


Gregg et al. 
(2007) 


Analyses indicated that vocabulary complexity, verbosity, spelling, and handwriting 
accounted for more variance in essay quality scores for writers with dyslexia than for 
their typically achieving peers. 

































Table F-4. Findings for perceptions related to accommodations used for assessment 



Educator perceptions are varying related to assistive technology use 


Atchison 

(2008) 


Survey results indicated that the knowledge and attitudes scores between the two 
groups were similar, however regression analysis identified a significant increase 
the attitude scores of employees of the special education cooperative as they 
gained work experience. Scores of district employees did not increase on either 
scale as participants gained work experience. 


Educators are confident in their knowledge of accommodations but perceive preparation 
programs and training as lacking 


Brown, W.M. 
(2007) 


Teachers reported that they were generally confident in their knowledge, but that 
they perceived their college teacher preparation programs and, to a lesser extent, 
their staff development programs, were lacking. In regards to the fairness of test 
accommodations both special and general education teachers also felt that it is fair 
that only students with disabilities and English as a Second Language students 
receive test accommodations. 


Educator perceptions are varying related to what specific accommodations look like and 
entail when carried out on test day 


Byrnes 

(2008) 


Although a majority of both groups agreed on interpretations of extended time, 
there was little agreement, considerable variation, and some contradiction in their 
understanding of the changes intended by scribing and preferential seating. 


Educators perceive accommodations as valid and easy to use 


Cawthon 

(2008) 


Participants perceived all listed accommodations as both valid and easy to use. 
Participants recommended that student academic level, communication mode, and 
additional disabilities be taken into account when choosing accommodations for 
students who are deaf or hard of hearing. 


Educators perceive accommodations as appropriate and would like to expand use 


Woods (2007) 


The findings were that the system for allocating access arrangements is considered 
‘manageable’ by 20% of teachers and ‘fair’ by only 25% of teachers; 70% of teach- 
ers considered extension of access arrangements to be appropriate, notwithstand- 
ing resource constraints. Qualitative data from the questionnaires highlighted the 
reasons for this pattern of results and a call by teachers for wider access in exami- 
nations to readers, scribes, extra time, and a word processing facility. 





















Table F-5. Findings for practices related to accommodations used for assessment 



States are beginning to form written accommodations policy for students with disabilities 
taking ELP exams 


Albus & 
Thurlow 
(2008) 


Although further investigation and empirical research is needed on accommodations 
for students with disabilities taking ELP assessments, especially as the number of 
these students continues to grow, this analysis of states showed some promising prac- 
tices. One of these states is using charts to address accommodations by domain of 
the assessment (e.g., reading, writing, listening, and speaking), being specific about 
those allowed or not allowed for each. Other practices included policies that take into 
account individual student needs rather than global decisions and states acknowledg- 
ing that decision making is an ongoing practice that can change over time (e.g., with 
the possibility of braille versions of assessments among future options). 


The provision of accommodations is variable depending upon the accommodations, educa- 
tional context, and student demographic characteristics 


Bottsford- 

Miller 

(2008) 


Results suggested that the provision of accommodations and modifications may vary 
depending upon the accommodation and the educational context. The probability of 
obtaining a specified accommodations or modification may change somewhat based 
on student demographic characteristics. 


Accommodations used in assessment increased overtime, as did the match with accommo- 
dations used for instruction 


Finizio 

(2008) 


Results indicated that accommodations use increased over time, accommodation 
match increased over time, accommodation assignment was not disability-specific, 
accommodation match was not disability-specific, and some accommodations may be 
instruction or assessment specific. 


Student recollection of accommodations provided does not match the recollection of educa- 
tors 


Hadjikakou 
& Hartas 
(2008) 


Six students stated that they were not allowed any extra time for assignments, two 
students said that occasionally extra time was given to them, with one student being 
allowed extra time frequently. All participants responded that brailled tests or tests 
with enlarged font were not available for students with visual impairment; furthermore, 
students with severe hearing impairment were not provided with sign interpretation or 
lip-reading of the questions nor were they allowed to use loop systems. Likewise, stu- 
dents with visual impairments were not allowed to use magnifiers during the exams. 
Regarding students with dyslexia, the Heads in seven higher education institutions 
stated that extra time for assignment was provided on a regular basis, and alternative 
ways of presentation, for example, oral rather than written, were allowed in accor- 
dance with the Pancyprian Association of Dyslexia. 


Students used accommodations in combination in an effort to level playing field 


Jerome 

(2008) 


Results from this study indicated that 77.9% of students with disabilities utilized ac- 
commodation during assessment, while 70% of students used more than one accom- 
modation. The pass rate of all students with disabilities was consistently lower than the 
state reported pass rate for all fifth grade students on the Spring 2004 administration, 
with students using accommodations having the lowest performance rate. 





















There is inconsistency between accommodations prescribed by lEPs and teacher’s recom- 
mendations 


Ketterlin- 
Geller, 
Alonzo et 
al. (2007) 


linconsistencies were observed between the accommodations listed on the IEP and 
the teachers’ recommendations. Similar results were observed when comparing either 
IEP or teacher recommendations with students’ performance. 


Medical school students do not typically request or receive accommodations for assess- 
ment 


Sack et al. 
(2008) 


The three major findings from the survey were: (a) 2.3% of medical students request 
accommodations for some form of disability; (b) vast majority of the requests for ac- 
commodation come from students with cognitive, rather than physical disabilities; and 
(c) many students with disabilities delay requesting accommodation until they experi- 
ence the rigors of the medical school curriculum. Accommodations offered usually 
consist of extra time and/or a quiet room for examinations. 


There is a need for a decision making tool or model to be put into practice 


Tindal et al. 
(2008) 


The outcomes from the judgments supported the need for a more explicit model. Four 
general categories are presented: student proficiency, ease of completing various (test 
relevant) activities, benefit from the use of various accommodations, and provision of 
accommodations in the classroom. Both mean level of ratings and stability of ratings 
argue against continued use of informal systems. 



Table F-6. Findings related to the read-aloud or oral administration accommodation for 
assessment 



The read aloud accommodation provided a differential boost to students with disabilities as 
compared to students without disabilities 


Bolt &Thurlow 
(2007) 


Within the elementary data set, we identified a significant Accommodation Group 
x Reading Difficulty interaction effect, such that the accommodation appeared to 
more positively impact student performance on items that were classified as dif- 
ficult to read. 


Brown, D.W. 
(2007) 


The read-aloud accommodation helped students with reading difficulties more 
than students whose reading skills were at or above teacher expectations. 


Ketterlin-Geller, 
Yovanoff, & 
Tindal (2007) 


Students with lower reading skills differentially benefited from the read-aloud ac- 
commodation on items with high mathematics difficulty and high linguistic com- 
plexity but did not benefit from a simplified language accommodation. This study 
illustrates the need to consider the interaction between item features and student 
characteristics in accommodations research. 


The read aloud accommodation improved the assessment performance of students 


Enriquez (2008) 


The results of this study suggested that Translated Oral Scripts seemed to make 
the biggest difference for all grade levels in terms of association with higher 
CSAP performance. Students with lower levels of English proficiency tended to 
benefit more from receiving accommodations than students with higher profi- 
ciency. 
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Temple (2007) 


Results indicated a greater increase in fluency, as measured by the Florida State 
Fluency Probes, from 2006 to 2007, for students in the read-aloud group (test) as 
compared with students in the sustained silent reading group (control group), and 
for students in grades 6 and 7 as compared with students in grade 8. The results 
of this study also found that read-alouds promoted increased performance of 
female students on the teacher-created tests. This suggests that read-alouds may 
play a role in increasing the performance of middle school at-risk female readers 
on similar instruments. 


The read aloud accommodations alters the construct being tested by making the item easier 


Elbaum (2007) 


Whereas mean scores for students both with and without LD were higher in the 
accommodated condition, students without disabilities benefited significant more 
from the accommodations (ES=0.44) than students with LD (ES = 0.20). 


Middleton 

(2007) 


In most cases, it was found that these item groups were relatively easier for RLD 
students when administered under accommodated than under non-accommo- 
dated conditions. Results were clearer for fourth than for eighth-grade students. 
These results also suggest that the construct for RLD students is more similar 
to the construct for NRLD students when both groups are assessed without the 
read-aloud accommodation than when the RLD students are assessed with the 
accommodation. 


The read aloud accommodation did not improve the assessment performance of students 


Harris (2008) 


The results suggested factorial invariance between test administration modes. In 
addition, no significant difference in student performance across the two modes 
was found. 



Table F-7. Findings related to segmenting text or passages in assessment 



The presentation of text or passages in segments did not positively affect the reading perfor- 
mance of students with disabilities or students without disabilities 


Abedi et al. 
(2008) 


The results of the segmenting study indicated that: (a) segmenting did not affect 
reading performance of students without disabilities; suggesting that it does not 
compromise the validity of reading assessment; (b) segmenting did not affect 
reading performance of students with disabilities. 


The presentation of text or passages in computer based assessment without segmenting 
had a negative effect on performance 


Keng et al. 
(2008) 


No evidence of item position effects emerged, but significant differences were 
found for several items and objectives in all subjects at grade 8 and in mathemat- 
ics and English language arts (ELA) at grade 1 1 . Differences generally favored 
the paper group. ELA items that were longer in passage length and math items 
that required graphing and geometric manipulations or involved scrolling in the 
online administration tended to be the items showing differences. 
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Appendix G 

Limitations and Future Research 



Table G-1. Authors’ Limitations by Study and Limitation Category 



Authors 


Sample 

Characteristics 


Test/Test Context 


Methodology 


Results 


Abedi et al. 
(2008) 


Students without dis- 
abilities may have 
struggled to show target 
skills affecting DIF. 








Albus & 
Thurlow 
(2008) 




Effects of sequence 
and test form ex- 
posure posed the 
greatest validity 
concerns. 






Atchison 

(2008) 


Lack of representative- 
ness of the sample for 
purposes of generaliza- 
tion. 




Methodology does 
not address current 
questions related to 
validity in the litera- 
ture. 




Bennett et al. 
(2008) 


Small sample size. 


Administration of 
the test was non- 
standard. 


Non-random sam- 
pling. 




Bolt & 

Thurlow 

(2007) 


Sample was non-repre- 
sentative as most were 
white and the average 
score was higher than 
the statewide average. 








Bolt & 
Ysseldyke 
(2008) 






No control group 
of students without 
ADHD to compare to. 




Bottsford- 
Miller (2008) 


Sample may not have 
been representative. 


Lack of congruence 
between items on 
both forms and am- 
biguous terminology 
on both surveys. 


Experimental control 
of the variables was 
not possible. 




Brown, D.W.* 
(2007) 










Brown, W.M. 
(2007) 


Schools in which 
technology was more 
accessible to students 
might have been more 
likely to participate. 
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Authors 



Byrnes 

(2008) 



Sample 

Characteristics 



Cawthon 

(2008) 



Sample was weighted 
toward teachers in 
schools for the deaf 
over those in main- 
streamed settings. 



DiRosa 

(2007) 



Elbaum 

(2007) 



Enriquez 

(2008) 



Finizio (2008) 



Sample of participants 
was relatively small. 



Gregg et al. 
(2007) 



Groups of schools and 
participants were not 
adequately representa- 
tive. 



Test/Test Context Methodology 



Provision of extend- 
ed time didn’t alter 
constructs, however 
other accommoda- 
tions did. 



Modifications were 
made to several of 
the performance 
measures used in 
the study. 



Results 



Data were col- 
lected in 2001 , 
and students have 
become more 
comfortable with 
technology since 
then. 



Accommodations 
use data are, in most 
cases, for groups of 
students and not for 
individual student 
and participants 
could remain anony- 
mous in their results 
and thus could not be 
reached to confirm 
the intent of open- 
ended responses. 



Data presented 
here can only 
attempt to be 
generalized to the 
technical configu- 
ration described in 
this research. 
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Authors 



Hadjikakou 
& Hartas 
(2008) 



Sample 

Characteristics 



Harris (2008) 



Jerome 

(2008) 



Kamei- 

Hannan 

(2008) 




(1) Sample is weighted 
toward teachers in 
schools for the deaf 
over those in main- 
streamed settings. (2) 
Participants in this 
sample are more likely 
to serve students who 
have more profound 
hearing loss, use ASL 
or sign language in 
instruction, and have 
additional disabilities. 



Keng et al. 
(2008) 


Sample consisted of 
only those taking re- 
takes at 1 1 th grade and 
was not representative. 


Ketterlin- 


Sample is composed of 


Geller, 


students who fall within 


Alonzo et al. 


a narrowly defined sub- 


(2007) 


set of the population. 


Ketterlin- 


Relatively small sample 


Geller, 


size. 


Yovanoff et 




al. (2007) 





Test/Test Context 



Participants may 
not have responded 
honestly to all ques- 
tions contained in 
the survey or may 
have consulted ref- 
erence materials or 
obtained assistance 
from other individu- 
als. 



Methodology 



Results 




Amount of time 
spent taking the 
test was influenced 
by many factors. 

For example, the 
amount of exposure 
to braille prior to the 
test affected fluency. 





Low participation 
rate. 



Accommodations 
use data are, in most 
cases, for groups of 
students and not for 
individual students. 




Teachers who 
serve students 
with moderate 
hearing loss or 
who use only 
oral language in 
instruction are 
underrepresented 
in this sample and 
may, for example, 
make different 
recommendations 
for best practices 
in accommoda- 
tions use. 
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Authors 



Kim & Huynh 
(2007) 



Kim & Huynh 
(2008) 



Lang et al. 
(2008) 



Sample 

Characteristics 



Schools in which 
technology was more 
accessible to students 
may have been more 
likely to participate. 



Inclusion of a non-rep- 
resentative and rela- 
tively small sample. 



Lee et al. 
(2008) 



Lewandowski 
et al. (2007) 



Lewandowski 
et al. (2008) 



Sample was small and 
homogenous. 



Test/Test Context 



Alternate test forms 
were used for PPT 
and CBT. 



Alternate test forms 
were used for PPT 
and CBT. 



Methodology 



Results 



Measures were 
adapted for group 
administration and 
the administra- 
tion was not “high 
stakes”. 



Single cohort of 
students. 



Limited to only one 
middle school. 



Students were clas- 
sified by the school 
and not researchers. 



Lindstrom & Two groups may have 
Gregg (2007) differed in their need for 
the accommodations. 



Lovett (2008) 



Middleton 

(2007) 



Survey is a prelim- 
inary exploration 
and the numbers 
reported must be 
considered esti- 
mates. 



No clear reason or 
common element 
for items exhibiting 
DIF. 



Confounding of 
the accommoda- 
tion meant to 
remove reading 
ability as a factor 
in performance 
with concomitant 
factors that are 
unrelated to read- 
ing ability. 
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Authors 



Puhan et al. 
(2007) 



Sample 

Characteristics 



Test/Test Context 



Sack, et al. 
(2008) 



Sharoni & 
Vogel (2007) 



Methodology 



Some analyses were 
limited to variables 
collected on the stu- 
dent data grid which 
eliminated some 
accommodations and 
native language abili- 
ties, etc. 



Study was not experi- 
mental, but a retro- 
spective study based 
on archival data files. 



Temple* 

(2007) 



Tindal et al. 
(2008) 



Wang et al. 
(2007) 



Wolf* (2007) 



Woods 

(2007) 



(1) ELL students are 
disproportionately rep- 
resented in the students 
with disabilities, specifi- 
cally learning disabili- 
ties. (2) Students were 
aware of the low stakes 
associated with the test. 



Student motivation is 
questioned as the test 
was a field test. 



Results 



Findings should 
be interpreted in 
light of the popula- 
tion studied and 
the measures 
used. 



Item quality is ques- 
tioned as the test 
was a field test. 


Analyses were only 
performed at two 
grade levels. 


Non-standardized 
administration of the 
assessment across 
testing proctors, sign 
language interpret- 
ers, and schools. 


(1) Statistical limita- 
tions, primarily result- 
ing from the size of 
the sample and the 
population. (2) Non 
random sampling 
was used. 



Students with 
dyslexia obtained 
lower quality 
scores that their 
peers even when 
other factors were 
taken into account. 



Those studies marked with an asterisk did not identify specific limitations. 
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Table G-2. Authors’ Future Research Directions by Study and Future Research Category 



Authors 



Sample 

Characteristics 



Test/Test Context Methodology 





Bennett et al. Random and larger 
(2008) sample, perhaps a 

multi-state investiga- 
tion. 



A single subject ap- 
proach to conduct 
studies into student 
performance under 
conditions with and 
without recom- 
mended accommo- 
dations, in a variety 
of contests, and with 
varied subject matter 
is essential. 



Standard test admin- 
istration. 




Results 



Focus less on 
whether accom- 
modations are 
differentially ef- 
fective for various 
groups of students 
and instead involve 
analysis of how 
target skills can best 
be measured across 
all students. 





A better understand- 
ing of the influence 
of high stakes on 
student and con- 
sumer reactions to 
tests and testing 
accommodations is 
needed. 




Experimental ap- 
proaches and 
carefully thought-out 
analyses of the grow- 
ing number of extant 
large-scale assess- 
ment databases. 



Determine optimal 
testing conditions 
for students with 
various educational 
difficulties. 
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Authors 



Bolt & 
Ysseldyke 
(2008) 



Sample 

Characteristics 



Bottsford- 
Miller (2008) 



Brown, D.W. 
(2007) 



Brown, W.M. 
(2007) 



Byrnes 

(2008) 



Cawthon 

(2008) 



DiRosa 

(2007)* 



Elbaum 

(2007) 



Test/Test Context 



Investigate comput- 
erized testing and 
how it improved 
the performance of 
students with ADHD 
even without further 
accommodation. 



Include a more repre- 
sentative sample with 
diverse backgrounds. 



Methodology 



Results 



Explore variations 
or similarities in 
individual student 
outcomes. 



Focus on the alter- 
ing of constructs and 
validity. 



Studies should 
report the mean and 
standard deviation 
on both modes, and 
also study design. 



The role of many 
underlying con- 
structs in large- 
scale testing, such 
as vocabulary, need 
to be examined 
further. 



Investigate the pos- 
sibility of differences 
between groups 
(such as race/ethnic- 
ity). 



Move to a field-based 
platform that both 
allows teachers to 
make decisions and 
systematically inves- 
tigates the effects 
using randomized 
designs. 



Single subject de- 
signs may provide a 
better understanding 
of the impact and 
functionality of ac- 
commodations. 
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Authors 



Enriquez 

(2008) 



Finizio 

(2008) 



Gregg et al. 
(2007) 



Sample 

Characteristics 



Hadjikakou 
& Hartas 
(2008) 



Harris (2008) 



Jerome 

(2008) 



Kamei- 

Hannan 

(2008) 



Research in other 
states especially 
around issues of 
teacher perceptions 
of necessary training. 



Include more than 
one school district 
and could probe re- 
spondents for further 
information. 



Test/Test Context 



Experimenting with 
individual and group 
administrations of the 
same measure will 
help methodologies. 



Increase sample size. 



More representative 
sample. 



Methodology 



Results 



Increase longitudinal 
parameters. 



Data regarding the 
attitudes and knowl- 
edge of educators on 
the subject of using 
assistive technology 
as an accommoda- 
tion on accountability 
assessments would 
be of value to district, 
state and federal or- 
ganizations in terms 
of evaluating and 
designing policy. 



Qualitative studies 
of accommodations 
decision making and 
accommodations 
validity. 



Development of MAP 
tests should apply 
principles of univer- 
sal design and follow 
guidelines set forth 
by CAST and NCEO. 



IEP team decision 
making and its ef- 
fects on results. 



Establish research 
programs in the UK 
as they have been 
in the US. 
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Authors 



Keng et al. 
(2008) 



Sample 

Characteristics 



Ketterlin- 
Geller, 
Alonzo et al. 
(2007) 



Ketterlin- 
Geller, 
Yovanoff et 
al. (2007) 



Test/Test Context 



Identify items with 
characteristics that 
show the potential 
to display mode DIF 
a-priori and then see 
if those items display 
significant mode dif- 
ferences. 



Kim & Huynh Include a sample 
(2007) with diverse back- 

grounds. Another 
important research 
directing includes 
understanding the 
role of school charac- 
teristics. 



Kim & Huynh More participants. 
(2008) 



Methodology 



Results 



Replicate the study 
design on a larger 
scale encompassing 
a number of school 
districts. 



Use experimental 
designs that capture 
student performance 
with and without 
accommodations 
and the targeted 
construct must be 
articulated at the item 
level to allow for ac- 
curate interpretation 
of student ability. 



Qualitative and 
survey research is 
needed to examine 
why teachers are 
selecting the accom- 
modations that they 



Lang et al. 
(2008) 



More detailed sur- 
vey on students in 
medical school using 
methodology that 
includes systematic 
reviews of actual re- 
cords at each school. 
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Authors 



Lee et al. 
(2008) 



Sample 

Characteristics 



Test/Test Context 



Lewandowski 
et al. (2007) 



More studies ex- 
amining the impact 
of read-alouds with 
older students in a 
variety of academic 
settings. 



Lewandowski 
et ai. (2008) 



Lindstrom & 
Gregg (2007) 



Lovett (2008) 



Methodology 



Follow-up using other 
cohorts needs to be 
undertaken as well 
as studying those 
students who take a 
psychometric exam 
for admissions pur- 
poses. 



Examine the condi- 
tions under which 
the differential boost 
effects are found. 



Middleton 

(2007) 



Puhan et al. 
(2007) 



The effects of differ- 
ent components of 
an accommodation 
should be indepen- 
dently assessed. 



Results 



Consider (1) The 
extent to which 
instructional accom- 
modations promote 
the learning of stu- 
dents with disabili- 
ties and (2) Vehicles 
for promoting stu- 
dents’ understand- 
ing, selection, and 
use of appropriate 
accommodations. 



Examine the use of 
DIF to validate score 
gains and explain- 
ing the source of the 
DIF. 



Accommodations 
that are offered in 
the state for which 
data is not collected. 
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Sample 

Authors Characteristics Test/Test Context 

Sack, et al. 

(2008) 



Sharoni & Replication with a 

Vogel (2007) diverse sample to 

verify the findings. 

Temple Examine fluency and 

(2007) standardized test 

connections at the 
secondary level. 



Tindal et al. Consideration of a The relationship 

(2008) focus on students between student 

with specific and motivation and non- 

varied disabilities is cognitive factors is 

necessary. work exploration. 

Wang et al.* 

(2007) 

Wolf (2007) f 



Woods 

(2007) 



* Those studies marked with an asterisk did not identify specific 



NCEO 



Methodology 

Further breaking 
down the learning 
disability category 
would allow more 
specific comparisons 
to be made. 



Examine the use of 
read-alouds in spe- 
cific content areas. 
Also, qualitative 
studies that include 
observations, case 
studies, surveys, in- 
terviews, and analy- 
sis of documents are 
needed. 



directions. 



Results 



See if the read- 
aloud strategy is an 
effective practice in 
specialized and in- 
clusive classrooms. 



Accommodations for 
students with dis- 
abilities taking ELP 
assessments 

A better understand- 
ing of the duplicative 
effect of cognitive 
and linguistic pro- 
cesses is critical. 
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